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Abstract 

The projection algorithm is frequently used in adaptive control and this note presents 
a detailed analysis of its properties. 



1 Introduction 

These notes started in [2] as a personal communication from Eugene to colleagues in the field 
of adaptive control and summarized results from O [TJ [3] . Properties of the projection 
operator are explored in detail in the following section. 



2 Properties of Convex Sets and Functions 

Definition 1. A set E C M fc is convex if 

\x + (l-\)y EE 
whenever x € E, y E E, and < A < 1 

Remark. Essentially, a convex set has the following property. For any two points x,y € E 
where E is convex, all the points on the connecting line from x to y are also in E. 

Definition 2. A function / : IR fc — > R is convex if 

/(Ax + (l-A)y)<A/(x) + (l-A)/(y) 

V0 < A < 1. 
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Lemma 3. Let f{9) : R k -> M be a convex function. Then for any constant 5 > the 
subset fts = {9 £ R k \f(9) < 5} is convex. 



Proof. Let Oi,02 € £ls- Then f(9i) < 5 and /(#2) < 8. Since f(x) is convex then for any 
< A < 1 

/( Afli + (1 - A)fl 2 j <A/(0i)+(l-A)/(0 2 ) < A<5 + (l-A)5 = <5 

.-. /(0) < (5, thus, fleOj. □ 

Lemma 4. Let f(9) : W k — > M be a continuously differentiate convex function. Choose a 
constant 5 > and consider Q§ = {9 £ M fc |/(0) < 5} C K. Let 9* be an interior point of 
i.e. f(9*) < 5. Choose 9b as a boundary point so that f(9b) = S. Then the following 
holds: 

(9* - 9 b ) T Vf{9 b ) < (1) 
where V f(9 b ) = ^ d $Q^ • • • 7%^) evaluated at 9 b . 

Proof. f{9) is convex .\ 

/ (X9* + (1 - X)9 b ) < Xf(0*) + (1 - X)f(9 b ) 

equivalently, 

/ (0 6 + X(9* - 9 b )) < f(9 b ) + X (f(9*) - f{9 b )) 

For any < A < 1: 

f (e b + x(9*-9 b ))-f(9 b ) ^ /(r ) _ m < 6 _ 6 = Q 

X 

and taking the limit as A — > yields ([1]). □ 



3 Projection 



Definition 5. The Projection Operator for two vectors 9,y 6 M is now introduced as 

?r°myj) = { y - ^™ F ym i <no)>«^m>o (2) 

I y otherwise. 

where / : M k — > M is a convex function and V/(0) = (^jf^- ■ ■ ■ 9 qq^ ) • Note that the 
following are notationally equivalent Proj(0,y) = Proj(0, y, /) when the exact structure of 
the convex function / is of no importance. 



3 PROJECTION 3 

Remark. A geometrical interpretation of ([2]) follows. Define a convex set fio as 

n = {e 6 R k \f(0) < 0} (3) 
and let Q\ represent another convex set such that 

fii = {9e ^ k \f(0) < 1} (4) 



From ([3]) and @ f^o C fli. From the definition of the projection operator in (J7|) is not 
modified when 9 € Qq. Let 

4 n^flo = {0|O < f(9) < 1} 

represent an annulus region. Within 0_4 the projection algorithm subtracts a scaled com- 
ponent of y that is normal to boundary = A}. When A = 0, the scaled normal 
component is 0, and when A = 1, the component of y that is normal to the boundary Q± is 
entirely subtracted from y, so that Proj(0,y, /) is tangent to the boundary {0\f(9) = l}. 
This discussion is visualized in Figure [TJ 




Remark. Note that (V/(#)) T Proj(#, y) = 0V# when f{9) = 1 and that the general structure 
of the algorithm is as follows 

Proj(0,y) = j/-a(t)V/(0) (5) 

for some time varying a when the modification is triggered. Multiplying the left hand side 
of the equation by (Vf(9)) T and solving for a one finds that 

a(t) = ((Vf(9)) T Vf(9))- 1 (Vf(9)) T y (6) 

and thus the algorithm takes the form 

Proj(0,y) = y - Vf(9) ((V f(9)) T V f(9)y 1 (V f (9)) T y f (9) (7) 

where the modification is active. Notice that the f(9) has been added to the definition, 
making ([7]) continuous. 

Lemma 6. One important property of the projection operator follows. Given 9* € 

(9-9*) T (Proj(9,y,f)-y)<0. (8) 



3 PROJECTION 



4 



Proof. Note that 

(0 - 0* ) T (Proj(0, y, f)-y) = (0* - 0) T (y - Proj(0, y, /)) 
If f{0) > A y T Vf{9) > 0, then 

,T ( ( V /W(V/(g ))" 



y ~ ( 2/ IIV7^flMI2 



and using Lemma [4] 

(0*-6)yf(0) (Vf(e)) T y 

^ ^ f(0) < o 



llv/WP 

>o 

otherwise Proj(#, y, /) = y. □ 

Definition 7 (Projection Operator). The general form of the projection operator is the 
n x m matrix extension to the vector definition above. 

Proj(e,y,iO = [Proj(0i,?/i,/i) ... PToi(9 m ,y m ,y m )} 

where = [#i ... 9 m ] £ R n * m ,Y = [ Vl ... y m ] € M raxm , and F = [f^Ox) . . . f m {e m )] T € 
R mxl . Recalling © 



j = 1 to m. 



^ yj otherwise 



Lemma 8. Let F =[f 1 ... f m ] T E R mxl be a convex vector function and = [0\ ... m ], 
[0! ... 9 m ],Y = {y x ... y m ] where 0, 9, Y 6 M" xm to, 

trace { (6 - 0) T (Proj(0, Y, F) - Y) } < 0. 

Proof. Using (jSJ), 

trace { (6 - 0) T (Proj(0, Y,F)-Y)} = - ^) T (Proj(^, /,) - 

< 0.D 

The application of the projection algorithm in adaptive control is explored below. 

Lemma 9. // an initial value problem, i.e. adaptive control algorithm with adaptive law 
and initial conditions, is defined by: 

1. = Proj(0,y,f) 

2. 0[t = o) = 9 e0 1 = {fle R k \f(0) < 1} 
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3. f(9) :R k —>Ris convex 
Then 9(t) € Q^t > 0. 

Proof. Taking the time derivative of the convex function 

f(9) = {Vf{9)) T 9 = (V/(#)) T Proj(0,y,/) (9) 

Substitution of © into fl2J) leads to 

f(8) = (Vf(0)) T Proi(8,y,f) 

_ Uvf{9)) T y{\ - f{9)) if f{9) > A y T Vf(9) > 
" 1 (Vf(8)) T y if f(0) < V y T Vf(9) < 

therefore 

7(0) >0 if < f{0) < 1 A y T Vf(9) > 

= if/(0) = lAy T V/(#) >0 
L/W < if/(0)<OVy T V/(fl)<O 

Thus /(0 O ) < 1 => f(0) < IV* > 0. □ 

Remark. Given 9q £ fio, may increase up to the boundary where f(9) = 1. However, # 
never leaves the convex set Oi. 

Example 10 (Projection Algorithm in Adaptive Control Law). Let 0(i) : IR + — > M. mxn 
represent a time varying feedback gain in a dynamical system. This feedback gain is imple- 
mented as: 

u = Q(t) T x 

where u € M. n represents the control input and x € W" 1 the state vector. The time varying 
feedback gain is adjusted using the following adaptive law 

G = Proj(G,-xe T P J B,F) 

where e € M m is an error signal in the state vector space, P £ j^ mxm j s a square matrix 
derived from a Lyapunov relationship and B £ jj m ><™ ^ g ^ e i n p U ^ Jacobian for the LTI 
system to be controlled and F(Q) = [/i(#i) ... fm(9 m ))] T . The projection algorithm 
operates with the family of convex functions 



/(0;<M) 



2e-& + e 2 ' 

Then, the components of the convex vector function F are chosen as 

fi(Pi) = m;0i,ei). (10) 

Each i— th component of F is associated with two constant scalar quantities i?j and £j. From 
(|10p . fi(9i) = when = and fi(9i) = 1 when = $j + £j. If the initial condition 
for is such that Q(t = 0) € Go = [#o,i ■ ■ ■ ^o,m] where {#o,i|/i(^i) < 0i = 1 to m}, then 
each 0j satisfies all three conditions for Lemma [9l Thus < i?i + e^Vi > 0. 
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4 T— Projection 

Definition 11. A variant of the projection algorithm, P-projection, updates the parameter 
along a symmetric positive definite gain T as defined below 

ProjK9, 5 ,/) = ( ry - r <W^ r!,/W »/W>OA I r r nw»o (u) 

[Ty otherwise. 
This method was first introduced in pQ. 
Lemma 12. Given 6* £ J)q, 

_ r ) T (r- 1 Pr O i r (0, y, /) - y) < 0. (12) 



Proof. If /(0) > A y T TVf(e) > 0, then 

V/(0)(V/(0)) T 



(r - ef (y - r- 1 (r y - r 

and using Lemma [4] 



(v/(0)) r rv/(0) 
(e*-e) T vm (vf(0)) T r y 



" -/W<o 



(v/(^)) r rv/(0) 

>o 

otherwise Proj r (0, y, /) = Ty. □ 
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